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Abstract 

Flavor changing neutral currents coming from a new non-universal neutral Gauge Boson and 
from the non-unitary quark mixing matrix for the SU(3) C (g) SU(3)l <S> U(l)x model with right 
handed neutrinos are studied. By imposing as experimental constraints the measured values of the 
3x3 quark mixing matrix, the neutral meson mixing, and bounds and measured values for direct 
flavor changing neutral current processes, the largest mixing of the known quarks with the exotic 
ones can be established, with new sources of flavor changing neutral currents being identified. Our 
main result is that for a | value smaller than one, large rates of rare top decays such as t — ► 07, 
t — ► cZ, and t — > eg (where g stands for the gluon field) are obtained; but if |T4&| ~ 1 the model 
can survive present experimental limits only if the mass of the new neutral Gauge Bosons becomes 
larger that 10 TeV. 

PACS numbers: 12.15.Ff, 12.15.Mm, 12.60.Cn 
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I. INTRODUCTION 

The standard model (SM) based on the local gauge group SU(3) C <8> SU(2) L eg) U{1)y [iL 
with all its successes, fails to explain several fundamental issues such as: hierarchical charged 
fermion masses, fermion mixing, charge quantization, strong CP violation, replication of 



a, 



families, neutrino masses and oscillations |2J|, etc.. All this make us think that we must call 
for extensions of the model. 

The flavor problem encloses two of the most intriguing puzzles in modern particle physics, 
which are the number of fermion families in nature and the pattern of fermion masses and 
mixing angles, both in the quark and lepton sectors. With each family being anomaly- 
free by itself, the SM renders, on theoretical grounds, the number of generations completely 
unrestricted, except for the indirect bound imposed by the asymptotic freedom of the strong 
interactions theory, based on the local gauge group SU(3) C , also known as quantum cromo 
dynamics or QCD. 

Many attempts to answer the question of hierarchical quark masses and mixing angles 
for three families have been reported in the literature, using the top quark as the only heavy 
quark at the weak scale |3j. But further insight into the flavor problem can be gained by 
contemplating the existence of additional heavy quarks. 

Popular and well motivated extension of the SM which containt extra heavy quarks are 
based on the local gauge group 

aaaaaa SU{3) C <g> SU{3) L <g> U(l) x (called hereafter 

3-3-1 for short). The several possible structures enlarge the SM in its gauge, scalar, and 
fermion sectors. Let us mention some outstanding features of 3-3-1 models: 

• The simple models are free of gauge anomalies, if and only if the number of families 
is a multiple of three 0, O, [f| (becoming just three by imposing QCD asymptotic 
freedom) . 



A Peccei-Quinn chiral symmetry can be implemented easily ldl. 111]. 



One quark family has different quantum numbers than the other two, fact that may 



be used to explain the heavy top quark mass 



3,Q- 



The scalar sector includes several good candidates for dark matter jl^ ]. 
The lepton content is suitable for explaining some neutrino properties [l5| 



The hierarchy in the Yukawa coupling; constants can be avoided by implementin. 



several universal see-saw mechanisms 
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In the SM with three generations, the quark mixing matrix, called in the literature the 
Cabibbo-Kobayashi-Maskawa (CKM) mixing matrix [18.], is a 3 x 3 unitary matrix. As a 
consequence of this unitary character, and for models with only one SM Higgs doublet, the 
flavor changing neutral currents (FCNC) are absent at tree level, with a strong suppression of 
the same FCNC at the one-loop level, due to the existence of the Glashow-Iliopoulos-Miani 



(GIM) mechanism 



For the minimall 3-3-1 model of Pisano-Pleitez and Frampton 



4] 



the quark mixing matrix is the same CKM mixing matrix of the SM, but FCNC at tree level 



appears due to the existence of a new, non- universal neutral Gauge Boson 20]. 

In this analysis we are going to study the FCNC at tree-level and the quark mass spectrum 
and its mixing matrix, for some 3-3-1 models without exotic electric charges. A classification 
of all those models has been presented allready in Refs. [7, 8, 9]. As far as the quark content 
is concerned, all the three family 3-3-1 models without exotic electric charges fall into four 
categories: Category A which includes models with four up-type quarks and five down-type 
quarks, Category B which includes models with five up-type quarks and four down-type 
quarks, Category C for models with six up-type quarks and three down-type quarks, and 
Category D for models with three up-type quarks and six down-type quarks. 

For all the models in the four categories above, the number of up-type quarks is not equal 
to the number of down-type quarks and thus, the quark mixing matrix looses its unitary 
character. One outstanding consequence of a nonunitary mixing matrix is the existence of 
new FCNC processes. 

Our aim in this analysis is to see, in the context of some 3-3-1 models without exotic 
electric charges, how large the mixing between the ordinary and exotic quarks can be, 
without violating current experimental measurements, both in the 3x3 ordinary quark 
mixing matrix and in the values and bounds measured for FCNC processes. 

This paper is organized as follows: in Sec. [Til we classify in four categories all the 3-3-1 
models without exotic electric charges, in Sec. II III we review the Gauge Boson, the fermion, 
and the scalar content of the 3-3-1 model with right handed neutrinos, calculate the effective 
tree-level Hamiltonian for FCNC and introduce the most general quark mass matrices for 
this model, in Sec. HVI we state the experimental constraints to be respected in the numerical 
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analysis carried through in Sec. |Vj In Sec. I VII the study of new FCNC processes in the 3-3-1 
model with right handed neutrinos is done and in Sec. IVHI we present our conclusions. An 
appendix at the end of the paper justifies the numerical analysis used in the main text. 



II. 3-3-1 MODELS WITHOUT EXOTIC ELECTRIC CHARGES 

In Refs. the classification of 3-3-1 models without exotic electric charges has 

been presented. In this section we will do a short summary of the eight three-family models 
obtained from the grouping of the following closed sets of fields (closed in the sense that 
each set includes the antiparticles of each charged particle) , where the quantum numbers in 
parenthesis refer to the [SU(3) C , SU(3)l, U(1)x) representations. 

• S\ = a~, E~); a + ; E+]l with quantum numbers (1, 3, —2/3); (1, 1, 1) and (1, 1, 1) 
respectively. 

• S 2 = [{ot~, v w N®); with quantum numbers (1, 3*, —1/3) and (1, 1, 1) respectively. 

• S 3 = [(d,u,U);u c ;d c ]U c ]L with quantum numbers 
(3, 3*, 1/3); (3*, 1, -2/3); (3*, 1, 1/3) and (3*, 1, -2/3) respectively. 

• S A = [{u,d,D);u c ]d c ;D c ] L with quantum numbers (3,3,0); (3*, 1,-2/3); (3*, 1,1/3) 
and (3*, 1, 1/3) respectively. 

• S 5 = [(e-,u e , iVf); (E~, A 2 °, A 3 °); (N%,E + ,e + )] L with quantum numbers 
(l,3*,-l/3);(l,3*,-l/3) and (1,3*, 2/3) respectively. 

• S 6 = [(v e ,e-,Ei);(E£,N^N$);(N$,E2,Ez); e + ;E?;E£) L with quantum numbers 
(1,3,-2/3); (1,3,1/3); (1,3,-2/3); (111), (111); and (111) respectively. 

The former set of fields is exhaustive in the sense that any other set will include either 
particles with exotic electric charges or 3-3-1 vectorlike representations. The several triangle 
anomalies for the former six sets are presented in Table I, which in turn allows us to build 
anomaly-free 3-3-1 models for one, two or more families. 
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TABLE I: Anomalies for Si 



Anomalies 
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J 3 
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J I 




^6 


[SU(3) c ] 2 U(l)x 




















[SU(3) L ] 2 U(1) X 


-2/3 


-1/3 


1 








-1 


[Grav] 2 U(l) x 




















[U(l)xf 


10/9 


8/9 


-12/9 


-6/9 


6/9 
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[SU(3) L f 


1 


-1 


-3 


3 


-3 
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A. Three family models 

Since data from LEP-I strongly favored the existence of three families of fermions with 
light neutrinos, we are going to concentrate in what follows only in models with just three 
families. 

From Table (Jill), only the following eight anomaly free three family models can be con- 
structed: 

• Models in Category A. 

1: 3S2 + S3 + 2S4, known in the literature as the 3-3-1 model with right-handed 
neutrinos [5]. 

2: Si + S2 + S3 + 2S 4 + S 5 , a model without universality in its lepton sector, studied 
in Ref. fl- 

3: 2S4 + 2S5 + S3 + S§. 

• Models in Category B. 

4: 3S1 + 2S3 + S4, known in the literature as the 3-3-1 model with exotic electrons 
5: Si + S 2 + 2S 3 + S 4 + S 6 , a second model without universality in its lepton sector, 



studied also in Ref. jj]. 
6: S 4 + S 5 + 2S 3 + 2S 6 . 

Models in Category C. 

7: 3S4 + 3S5 a three family model, carbon copy of the one family model studied in 
Ref. [2J] 



Models in Category D. 



8: 3S3 + 3Sq a three family model, carbon copy of the one family model studied in 
Ref. [22] 

As far as we know, models 3 and 6 above have not been studied in the literature yet. 

Due to the fact that the three models in Category A have the same quark content (four 
up type quarks and five down type quarks with the third family of quarks transforming 
different than the other two), the following analysis of the FCNC at tree- level and of the 
quark mass spectrum, is valid for the three models in that Category, including the popular 3- 
3-1 model with right-handed neutrinos 
way to the other models). 



5| (the analysis can be extended in a straightforward 



III. THE 3-3-1 MODEL WITH RIGHT HANDED NEUTRINOS 



Let us review briefly the so-called 3-3-1 model with right-handed neutrinos: 



A. The Gauge Group 



As it was stated, the model we are interested in, is based on the local gauge group 
SU(3) C ® SU(3)l <S> U(1)x which has 17 gauge bosons: one gauge field associated with 
U(l)x, the 8 gluon fields G M associated with SU(3) C which remain massless after spontaneous 
breaking of the electroweak symmetry, and another 8 gauge fields associated with SU(3)l 
that we write for convenience as 



a=l 



\ 



(1) 



where = A^/^2 + A^/^6, D% = -A^/^2 + A^/^6, and D% = -2A%/V&. X a , a 
1,2, ...,8, are the eight Gell-Mann matrices normalized as Tr(\ a \@) = 28 ' a p. 

The charge operator associated with the unbroken gauge symmetry U(1)q is given by: 



^ 2 



2V3 



Xh 



(2) 
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where ^3 = Diag.(l, 1,1) is the diagonal 3x3 unit matrix, and the X values are related 
to the U(l)x hypercharge and are fixed by anomaly cancellation. The sine square of the 
electroweak mixing angle is given by 



S w = Sgf/iSg! + 4gl 



(3) 



where g\ and g% are the coupling constants of U(l)x and SU(3)l respectively, and the 
photon field is given by 



Aq — SwA% + Cw 



^ + ^(1 - Tys)B^ 



(4) 



where Sw, Cw and T w are the sine, cosine and tangent of the electroweak mixing angle 6w, 
respectively. 

There are two weak neutral currents in the model associated with the two neutral weak 
gauge bosons 

T w 



— S* 



A» + J(l-T w /3)B^ 



1 - I^/3K + 



(5) 



and another electrically neutral current associated with the gauge boson K 0tl . In the former 



expressions Z$ coincides with the weak neutral current of the SM 



BQ. 



The physical fields 



Zi and Z% are defined by Zf = cosOZ^ — siiiOZq and Z% = smOZy + cosOZq - , where 9 is 
a small mixing angle fixed by phenomenology (8 < |0.001|, which in turn implies Mz 2 > 2.1 
TeV, with a larger mass bound associated to a smaller mixing angle 17||). 

Using Eqs. (HI) and ([5]) we can read the gauge boson F M associated with the U(l)y 
hypercharge of the SM 

(6) 



A%+ J(l-T w /3)B^ 



Equations ([U16]) presented here are common to all t 
exotic electric charges 

ABB 

as it is analyzed in Refs. 



re 3-3-1 gauge structures without 
3- 



B. The Fermion sectors 



The quark content for the three families in this model, which is the same for the 3 models 
in Category A, is the following: Q l L = (u\d\D % ) L ~ (3,3,0), i = 1,2 for two families, 
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where D\ are two extra quarks of electric charge —1/3; Q\ = (c1 3 ,u 3 ,U)l ~ (3, 3*, 1/3), 
where Ui is an extra quark of electric charge 2/3. The right handed quarks which belong 
to SU{3) L singlets are uf ~ (3*, 1, -2/3), df ~ (3*, 1, 1/3) with a = 1, 2, 3 a family index, 
Df ~ (3*, 1, 1/3), i = 1, 2, and £/£ ~ (3*, 1, -2/3). 

The lepton content is given by the three SU(3)l triplets Lit = uf, uf c )i ~ 
(1,3*,— 1/3), for I = e,fi,r a lepton family index, and the three singlets l\ ~ (1,1,1), 
where uf is the neutrino field associated with the lepton l~, and uf c plays the role of the 
right-handed neutrino field associated to the same flavor. For this model universality for the 
known leptons in the three families is present at tree level in the weak basis. 

C. The scalar sector 

The following is the set of scalar fields and Vacuum Expectation Values (VEV) used in 
order to break the symmetry and to give a consistent mass spectrum to the fermion fields : 

(f x ) = ((#, 0?, <f>[ )) = ((0, 0, V)) ~ (1, 3, 1/3); (7) 
($) = ((0+0°,0;°)) = ((0,^,0)) -(1,3,1/3); 
(0f) = ((0°,0 3 -,0;-)) = (K 0,0)) -(1,3,-2/3); 

with the hierarchy v% ~ ^2 ~ 10 2 GeV << V ~ TeV. 

The analysis shows that this set of VEV breaks the SU (3) c ® SU (3) l <8> U{l)x symmetry 
in two steps following the scheme 

3-3-1 SU{S) c ®SU{2) L ®U{l) Y 
S£/(3) C ®E/(1U, 

for i — 1,2 and Z7(1)^m the Abelian gauge group of the electromagnetism. 

D. FCNC at tree level 

In the context of most of the 3-3-1 models considered in this paper, the third family of 
quarks is treated differently than the other two; so, it has different couplings to the scalars 
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as well as to the new neutral current J%, present in the model (the quark couplings to the 
SM neutral current is not only diagonal in flavor but also it is universal). Due to this, 
new FCNC at tree level show up, which in principle contribute to FCNC processes which 
are severely constrained by experiment, most notably by meson mixing [201 ] . 

For the 3-3-1 model with right-handed neutrinos, all the currents were allready calculated 
in Ref. Using for the photon field the expression in Eq. and for and Z'^ the 
definitions in (jSJ), the neutral currents, associated with the Hamiltonian 

H° = eA%(£M) + {gz/Cw^J^Z) + (g./^Z'^J^Z'), (8) 



arc 



2 3 

J^(EM) = (Y.Ual^a + U^^U 

6 o=l 

I 3 2 

-«£ d al^d a + £ D iJl* D i) 
6 a=l t=l 

- E r-rj 

l=e,n,T 

r(EM) = J^QffrL (9) 

/ 

J»(Z) = r L (Z)-S 2 w J»(EM), 
J»(Z') = T W J»(EM) - J£(Z'), 



where e = gSw = <?'CVy 1 — > is the electric charge, qf is the electric charge of the 

fermion / in units of e, J 11 (EM) is the electromagnetic current, and the left-handed currents 
are given by 



and 



/ 0=1 

I 

f 



(10) 



J£(Z') = S^(u 1L ^u 1L + u 2L ^u 2L -d ZL ^d^ L 



+T 2 w(d 1L YdiL + d 2 Ll^d 2 i - u 3L ^u 3L 

- E vilI^Vil) 

i 

+T W \D 1L ^D 1L + D 2L ^D 2L - Ul^Ul 

- e viii^ii) = e hn f ^h, (ii) 

with T 3 f = diag(l/2, — 1/2, 0). = diag(S2w,T 2 ~ w , —T^ 1 ) is a convenient 3x3 diago- 
nal matrix (both marices T 3 j and acting on the representation 3 of SU(3)l, with their 
negative values when acting on the representation 3*). / is a generic symbol for the repre- 
sentation 3 (and 3*) of 5C/(3)l[5], and Jl{Z') allthough diagonal in the weak basis is not 
universal. 

The couplings of the left-handed quarks with the Z' Gauge Boson, can then be written 
in the form 

C(Z') = 6 Z'^(Z'), (12) 

with 



J»(Z') = -L E mS w Y - 2V3C 2 w T 8L ]P L f, (13) 

where Pl = (1 — 7 5 )/2. Since the value of T$l is different for triplets and antitriplets, the 
Z' coupling is different for the third family and we have FCNC a tree level. These currents 
can be written in the form: 

J^fcno = ~ E MTsl - r; L ]p L f = -^E /VW, (u) 

with the tree level effective Lagrangian for these FCNC calculated to be 

£ {FCNC) = 93 ° w {S e Z» + C 9 Z£) E HPlU (15) 
V( 3 " AS w) f 

where 9 is the mixing angle between the two massive neutral Gauge Bosons Z and Z' which 
defines the physical states Z\ and Z 2 respectively (this angle is very small as can be seen 
from the last paper in Ref. jq]). 

Beacause the third family of quarks is treated differently we have that 
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3% = [U^PlVI 



ut 



a-1 
°2W 



(J-l 



1 2W 



VZUYD^P L Vi 



rp-1 
1 2W 



rp-1 



2W 



V 



Tw 1 ) 
(16) 



where W and T> are four column and five column vectors for the up and down quark sectors 
respectively, and V£ and V£ are the 4x4 and 5x5 unitary matrices which diagonalize the 
mass matrices of the up and down quark sectors respectively, with V m i X = V£V^ the non- 
unitary 4x5 quark mixing matrix in the context of this particular model (see the following 
Section). As can be seen, 3%/ in Eq. fflBI) induced FCNC a tree level. 

Using the tree-level current in Eq. ( fTBT) . the following effective Hamiltonian can be ob- 
tained 



\H 



effl 



(3-4Sf r ) <■■"-■*">• >M| 2 1 • (17) 

which can be used to calculate the tree- level diagrams for K° — K°, D° — D°, B^ — B^ and 
B° s — B° s mixing just by replacing (a,/3) by (d,s), {u,c), (d,b) and (s, b) respectively. An 
equation similar to ( TlTl) but for the minimall model 4| has been derived in Ref. 23 1. 



E. Mass matrices 



In this subsection we are going to present the most general quark mass matrices for all 
the 3-3-1 three family models without exotic electric charges belonging to Category A, and 
to set our notation. 

The Higgs scalars introduced above are used to write the Yukawa terms for the quarks. 
In the case of the up quark sector, the most general invariant Yukawa Lagrangian is given 
by 

£y = E Q\KC{h u JJl + E h u aa ul c ) (18) 

a=l,2 a=l 

+ E K a u a L c + hfui) + h.c, 

i=l a=l 
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where C is the charge conjugation operator. In the weak basis U = (it , u 2 ,u 3 , U) the former 
Lagrangian produces the following 4x4 quark mass matrix for the up quark sector 



Mi 



u 



( v 2 hf x v 2 h& v 2 h% v 2 hf ^ 
v 2 h%L v 2 h u 2 ' 2 v 2 h% v 2 h u 2 ' 
v x h X2 v x h 22 v x h% 2 v x h 2 



VKt x Vhl x Vh\ 



(19) 



For the down quark sector, the most general Yukawa Lagrangian is now 



o=l,2 % a j 

+QlfoCC£h?D- + Y / h d a dl c ) + h. 



.a. 



(20) 



which in the weak basis D = (d 1 , d 2 , d 3 , D 1 , D 2 ) produces the following 5x5 quark mass 
matrix for the down quark sector 



( v x hf X2 v x hf 22 v x hf 32 v x hf X2 v x hf 22 ^ 
v x h^ X2 v x h d 222 v x h% 32 v x h^ X2 v x h% 22 



M. 



D 



(21) 



v 2 hf v 2 h 2 v 2 h d v 2 h x v 2 h 2 
Vhf xx Vh d X2X Vhf 3X Vh» xx Vh? 2X 
\Vh d 2XX Vh d 22X Vhj 3X Vhg x Vhg x J 
Mjj and in ( jl~9i) and ( 1211) must be diagonalized in order to get the mass eigenstates 
which exist in nature, defining in this way a non-unitary 4x5 quark mixing matrix of the 
form 



V mix = V£Wl 



(22) 



^ V u d V us V u b V u b' V u b" ' 
V c d v cs V cb V cb i V cb » 
V t d V ts V t b V t y V t b" 
Vfd Vf s Vfb Vfy Vt'b" 

where V£ and V d are 4x4 and 5x5 unitary matrices which diagonalize MjjMy and MpM^ 
respectively, and V is the projection matrix over the ordinary quark sector (in the weak 
basis, the exotic quarks transform as singlets under SU(2)l transformations, thus they do 



V 



/ 
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not couple with the W ± Gauge Bosons). This matrix is given by 



^ 1 0^ 



V 



10 
10 




(23) 



Vmix in (1221 defines the couplings of the physical quark states, (w, c, t, t r ) and (d, s, b, b', b") 
with the charged current associated with the weak gauge boson W + . 

IV. EXPERIMENTAL CONSTRAINTS. 

In the quark sector, several parameters have been measured with high accuracy, with 
values which constitute some of the strongest experimental constraints for model builders. 
The following three sets of numbers are going to be considered in what follows: 



A. The 3x3 quark mixing matrix 

The masses and mixing of quarks in the SM come from Yukawa interaction terms with 
the Higgs condensate, which produces two 3x3 quark mass matrices for the up and down 
quark sectors; matrices that must be diagonalized in order to identify the mass eigenstates. 
The unitary CKM quark mixing matrix (Vckm = ^3l^3l) couples the six physical quarks 
to the charged weak gauge boson W + , where V£ L and V% L are now the diagonalizing unitary 
3x3 matrices of the SM up and down quark sectors respectively. 

The unitary matrix Vckm has been parametrized in the literature in several different 



ways, but the most important fact related with this matrix is that most o 
been measured with high accuracy, with the following experimental limits 



its entries have 



exp 



( 0.970 < \V ud \ < 0.976 0.223 < \V US \ < 0.228 0.003 < \V uh \ < 0.005 \ 

0.219 < \V cd \ < 0.241 0.90 < |V CS | < 1.0 0.039 < \V ch \ < 0.045 
\ 0.006 < \V td \ < 0.008 0.036 < \V ts \ < 0.044 \V tb \ > 0.78 J 



(24) 



The numbers quoted in matrix T2/^i , which are measured at the Fermi scale (fi ~ Mz) 25| . 
are generous in the sense that they are related to the direct experimental measured values, 
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some of them at 90% coffidence level, with the largest uncertainties taken into account, 
without bounding the numbers to the orthonormal constrains on the rows and columns of 
a 3 x 3 unitary matrix. In this way we leave the largest room available for possible new 
physics, respecting the well measured values in V exp . 

The most conservative alternative of using numerical entries which take into account 
unitary constraints in V exp is going to be considered also at the end of our study. 



B. Direct FCNC searches 



The unitary character of the SM mixing matrix Vckm implies flavor diagonal couplings 
of all the neutral bosons of the SM (such as Z boson, Higgs boson, gluons and photon) to a 
pair of quarks, giving as a consequence that no FCNC are present at tree level. At one-lo_o 
level, the charged currents generate FCNC transitions via penguin and box diagrams 



>op 

k 



but they are highly suppressed by the GIM mechanism [19j. For example, FCNC processes 
in the charm sector (c — > wy) were calculated in the context of the SM in Ref. [26|, giving 
a branching ratio suppressed by 15 orders of magnitude, leaving in this way a large window 
of opportunities for new physics in charm decays. 

To date, the following direct FCNC branching ratios and bounds have been measured in 
several experiments: 



Br[b -► sj\ = (3.52 ± 0.24) x 10" 4 [27| 



Br[B -»• K*l+l-\ = (1.68 ± 0.86) x 10~ 6 [28J, 



• Br[s -> di{dl+l-)] < 10~ 8 |2J 

• Br[c -> uin~] < 4 x 10~ 6 

• Br[b -> sZ+r, din~] < 5 x 10" 7 |3lj 

with I = e, fi. In our study, these ratios and bounds are also going to be respected. Important 
to mention here that the SM next to next to leading order calculation for Br[b — > 57] is 
(3.60 ± 0.30) x 10~ 4 |32[], allready in agreement with the measured value, which constitutes 
a very sensitive prove of new physics. 
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C. Indirect FCNC searches 



In general, flavor physics processes and in particular meson mixing, are known to con- 
straint FCNC of the type produced by a non-universal Z' Gauge Boson. At present the 
most severe constraints arise from K°, D°, B% and B® neutral meson mixing. To date, the 



following experimental measurements have been obtained 
• Amjfo = 0.5290 ± 0.0016 x lO 10 /^- 1 



24j: 



Am D o = 7 x lO 10 ^" 1 



Am B o = 0.507 ± 0.005 x ps^ 1 [33 1 . 



• Aniflo = 17.77 ±0.17 ps~ l [33j, 
numbers which severely constraint models with FCNC occurring at the tree-level. 



V. NUMERICAL ANALYSIS. 



As it is expected from Eq. ffTTl) . FCNC at tree-level are depleted when the ordinary 
quarks mix with the exotic ones, the largest the mixing, the smaller the FCNC effects. 
In this section we are going to see, in the context of the 3-3-1 model with right-handed 
neutrinos, how large the quark mixing can be, without violating the experimental measured 
values quoted in the previous section. 

In the analysis we assume that V\ — v 2 = v — 123 GeV, value supported by the result 
M^y = gl(vf + f|)/2 [5j with g 3 the gauge coupling constant of SU(3)l (that is equal to g 2 , 
the gauge coupling constant of SU{2) L in the SM), and also we use V = 1 TeV, the 3-3-1 
mass scale which fixes the mass values for all the new fermions of the different models. 



A. The 4x5 mixing matrix 

In this section we are going to study the non-unitary 4x5 quark mixing matrix V m i X 
in Eq. fl22|) for the three models in category A (models with four up-type quarks and five 
down-type quarks) including the 3-3-1 model with right handed neutrinos. What we pretend 
to do is to look for the maximall mixing of the ordinary quarks with the exotic ones, without 
violating the experimental constraints quoted in the previous section. 
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Ml 



( 



\ 



(25) 



Let us start first with what we have called the down-up approach, which consists of 
looking for quark mass matrices which fit the experimental constraints of V exp in (124p . with 
a value V t b ~ 0.8, the smallest possible. The numerical analysis suggest to start with the 
following orthogonal quark mass matrices 

( 0.00047 0.02812 ^ 

0.02812 0.580 

171.7 

m t > j 

0.018 -0.4288 -2.63 -3.41 

-0.4288 9.316 57.608 75.98 

-2.63 57.608 361.8 472.4 

-3.41 75.98 472.4 624.5 

my, ) 
which for m t > = my = 1500 GeV, reproduce the following set of eigenvalues (in units of 
GeV) 



\ 



\ 



(26) 



m t = 171.7, m c = 0.582, m u = 1.4 x 10" 
m b = 2.83, m s = 0.069, m d = 3.4 x 10 



-3. 



m t ' = 1500, my/ = 1500, my = 993, 

numbers to be compared with the values quoted in the appendix (taken from the second 
paper in Ref. [25||). 

The rotation matrices which diagonalize M% and Mg are 

/ n nno/i n ncso n n \ 



v 4 u 



0.9984 -0.0563 

0.0563 0.9984 

10 

1 



and 



V? 



V 

( 0.9850 
0.1724 
0.011 

-0.0044 0.0965 




(27) 



0.172 0.006 -0.02 0^ 

-0.9798 0.031 0.097 

0.0366 -0.798 0.602 

0.602 0.7925 

ly 



(28) 



rd 
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Matrices which combine to produce the folowing non-unitary 4x5 mixing matrix V r 



4x5 
mix 



\v?vv^\ 



1 0.974 0.227 0.008 0.0098 ^ 



ta4x5 

mix 



(29) 



0.227 0.9685 0.0371 0.096 
0.0060 0.031 0.798 0.602 

numbers to be compared with the experimental limits in (124")) and with the numbers quoted 
in the appendix for V^f x in fjAllf) for the up-down approach. 



V 



/ 



VI. NEW FCNC PROCESSES 



Next, we are going to evaluate the new contributions to the FCNC processes coming from 
the nonunitary character of V m * x in Eq. (1291) . and from the rotation matrices V£ and V§. 



A. Penguin processes for the SM quarks 

The following are the penguin contributions to the FCNC coming from V r 



4x5. 
mix ' 



1. The bottom sector 

Let us evaluate first the electromagnetic penguin contribution to Br f (b — ► 57) coming 
from the t quark, calculated with the expectator model, scaled to the semileptonic decay 
b — > qihfu Qi — c ,u, and without including QCD corrections (which are small for the b 



sector 



0). 



This value is calculated to be 



26] 



Br l {b — > sj) 



where a is the fine structure constant, Bb 



3a 




2vr [f(x c ] 


\v cb 


2 + f(x u )\V ub 


2 ] 



B 



(30) 



*xiui ~ 0.1 is the branching ratio for semileptonic 
b meson decays taken from Ref. 24j], x l = (mt/Mw) 2 , x c = m c /mb and x u = m u jm b . F®(x) 
is the contribution of the internal heavy quark line to the electromagnetic penguin given by 



F Q (x) = Q 



x 3 — 5x 2 — 2x 3x 2 lnx 
+ 



Ax - 1 



2(x 
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2x 3 + 5x 2 — x 3x 3 In x 



A(x-l) 3 2(a;-l) 4 ' 
where Q = 2/3 for t in the quark propagator [Q = —1/3 and x = x b ' = (my/Mw) 2 when b' 
propagates, with the appropriate changes when b" propagates] and f(xi) is the usual phase 
space factor in semileptonic meson decay, given by |l| 



f(x) = 1 - 8x 2 + 8x b - x s - 24x 4 In a;. 

For the numerical evaluations of Br l {b — > 57), let us use the values oflGeU) = 1/135, 
m t = 171.7 GeV, m c = 0.6 GeV, m fc = 2.8 GeV and m u = 1.4 MeV [23] (which are not 
the pole values). Using these numbers we obtain: F 2 ^ 3 (x t ) ~ 0.387, f(x c ) ~ 0.72 and 
f(x u ) ~ 1. Plug in the numbers in Eq. (|30|) and using the values for in equation (|29|) 
for the couplings of the physical quark states, we get 

Br\b -»• 57) w 3 x 10" 5 , 

close to the SM calculation as it should be, since this process does not receive a contribution 
from the exotic quarks. 

The former analysis can be used also to estimate the branching ratios for the rare gluon 
penguin decay b — ► sg, where g stands for the gluon field. The results is 

,„ , a.(lGeV)„., 



w 13Br\b -> 57) ss 3.9 x 10" 4 , 

a process difficult to meassure due to the hadronization of the gluon field g. (This last process 
is of the same order of magnitude of the virtual weak penguin bottom process b — > sZ) . 
A similar analysis shows that 



\V I 

Br\b -> di) = y%Sr*(6 -> s 7 ) ss 1.16 x 10' 



which is safe and in agreement with the bounds quoted in Section (lIVBp . 
2. The strange sector 

In a similar way we can evaluate Br l (s 0^7) scaled to the semileptonic decay s — > ulfi, 
which is given now by 

27T /«)|K S | 2 ( } 
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With x' u = m u /m s , m s (lGeV)=69 MeV, and B K ^ n i Ul » 
we get 

Br\s -> dry) « 1.75 x KT 11 , 



5 x 10~ 2 taken from Ref. |24| . 



in agreement with the experimental bound quoted in Section fllVBj) 



3. The charm sector 



Now let us evaluate Br b ' (c — > 1*7) scaled to the semileptonic decay c — > g,/^/, where 
gj = s, d. The branching ratio is 



B 



M 2nlf(x s )\V cs \* + f(x d )\V cd \*Y 



(32) 



where x s = m s /m c , x d = m d /m c . With Bd->x s Ivi ~ ^.2 taken from Ref. 24| . F l ^{x b ') 
0.3849, /(x s ) » 0.895 for m s = 150 MeV and f(x d ) « 1, for m d = 3.4 MeV, we get 



-10 



£r 6 '(c -»• ui) « 1. x 10 

five orders of magnitude larger than the SM prediction [26], but still unobservable small. 
Of course, the quantum QCD corrections for this decay could be quite large (see the second 
paper in Ref. [2a]). 



4. The top sector 

We proceed this analysis with the study of the FCNC for the top quark in the context of 
the three 3-3-1 models in category A. As we are about to see, some of the predictions are 
ready to be tested at the Large Hadron Collider (LHC). 

In the SM, the one-loop induced FCNC for the top quark have a strong GIM suppression, 



resu 
are 



ting in negligible branching ratios for top FCNC decays. The SM values predicted 
3gj. Sr SM {t -> cry) « 4.6 x 10~ 14 , and Br SM {t -> eg) « 4.6 x 10~ 12 . 



The new FCNC Br h ' (t —> 07) and Br b> (t — ■> wy) predicted for the top quark in the 
context of the 3-3-1 model with right-handed neutrinos, scaled to the semileptonic decay 
t -> q k lv h q k = b, s, d; are given by 

Br b \t - c 7 ) „ 3a \{V? v V cV )F-V\x b ')\* 



Bt^xiu, 2n[f(x b )\V tb \* + f(x s )\V ts 
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which we evaluate at the m t = 171.7 GeV, the pole mass scale for the top quark, which gives 



Br b '(t -> 07) « 2.75 x 10~ 6 B T . 



■Xlu t , 



which is large as far as the semileptonic branching ratio Bt^xiu { measured for the top quark 
gets comparatively large, and much larger than 10~ 14 , the SM prediction. 
From the former analysis we can get 

4-7T 

Br b '(t -> cZ) = . /nn . Br b \t -> try) « 40£r b '(t -> try), 
sin (20) 

two orders of magnitude larger than Br b ' (t — > 07), a value not far from the LHC capability, 
with a similar conclusion for the branching Br b ' (t — > eg), where g> stands for the gluon field. 
Finally we find 



Br b '(t^ U1 ) « ^Li3r fe '(t^c 7 ) 



1^, 
2.85 x 10 _8 fi T - 



B. Penguin processes for new quarks 

As can be seen from the former calculations, the GIM cancellation does not proceed 
for 3-3-1 models in general, mainly because the nonunitary character of V m * x f, with the 
branching ratios proportional now to F®(x) 2 , which is a function of x = m 2 q ,/M'^ v 3> 1, for 
q' = t', b', b". 

To make predictions for the new quarks, a hierarchy between the heavy states must be 
assumed; for example, for rrif > my ~ my> > m t , and scaling the branching ratio to the 
semileptonic decay b' — > Ulvi for U — t,c,u, we get 

Br\b> -> 67) „ 3a |^,^F 2 / 3 (x)| 2 

2tt [/(x t )|^/| 2 ] ' v 7 



which for m t = 151 GeV 25] produces the result 



Br*(6' -> 67) « 2.4 x KT 4 ^ 



a value large enough to be detected at the LHC, even if the branching ratio B T i^ Xb Ivi is 
small. 
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C. Meson mixing at tree-level 



The strongest constraint for the model under consideration here, comes from the new 
tree-level FCNC produced by the non-universal Z 1 neutral Gauge Boson. Ignoring CP- 
violating effects and using the results in Eq. (ITTj) , the K° — K° mass difference produced 
by the physical Z^ Gauge Boson, turns out to be 



{AmK)z > = 4 ^-4^|f K^)32(^)3i| V + Tl ) B K f K m K , (35) 



where the leading order QCD corrections have been included through the parameter rjk ~ 
0.57 [411 ]. Bk and fx are the bag parameter and the decay constant for the kaon system 
respectively, and Cq and Tg are the cosine and tangent of the small mixing angle 9 needed 
to define the physical fields and Z% ■ 

As can be seen, for a small mixing angle 9, Arrik is an inverse function of M§ 2 , the 
physical mass of the new neutral Gauge Boson. Our approach here is to use the experimental 
measured value Am^ to set a lower bound for M Z2 - 

Using the numerical values G F = 1.166 x 10~ 5 Gev -2 , 9 W = 31.93, M Zl = 91.2 Gev., 
Am fc = 3.48 x 1CT 12 MeV., y/B^f K = 135 MeV, m k = 497.65 MeV; neglecting the small 
mixing angle 9 and using (V^)3 2 (V^ d )3i from the rotation matrix in (|28~I) . the final value turns 
out to be Mz 2 > 0.2 TeV, one order of magnitude smaller than previous values calculated 
for this model 

Now, for this down-up approach, there is no prediction coming from the D° — D° mixing 



(for which Am D = 4.607 x 10~ n MeV., VB^f D = 187 MeV [411,771^ = 1864.5 MeV, and 
r] D ps 0.57) due to the zeroes in V±. 

For the bottom sector we have for the B% — B® mixing, with Am B o = 3.37 x 10~ 10 
MeV., sfB~^f B = 208 MeV [4l|, m B = 5279.4 MeV, and rj B ~ 0.55, that M Z2 > 2.1 TeV. 
For the B° s - B° s mixing with Am B o = 1.17 x 10 -8 MeV., we obtain a limit M Z2 > 1.18 
TeV; both mass limits in agreement with the calculated value for this model, using precision 



measurements of the SM parameters 17 1. 



The conclusion here is that in general, for the down-up approach, the new neutral meson 
mixing, coming from the tree-level FCNC, do not violate current experimental measurements 
as far as 

M Z2 > 2.1TeV, (36) 
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FIG. 1: One-loop diagram contributing to the FCNC b 



mass value which justifies the assumption of neglecting the small mixing angle effects in 
Eq. (l3"5]) due to the fact that T| < 2.43 x 1(T 6 << {M z jM Z2 f. 

But when the mixing angle is taken different from zero, there are new contributions to 
the meson mixing at tree-level, coming from the physical Zf Gauge Boson, given now by: 

(Am*)* = (Am K ) Z2 T e [ M^JM^+Tf 

< 0.3(Am K ) Z2 , (37) 

where Sg stands for the sine of the mixing angle 9, and the numerical evaluation has been 
done for M z . 2 « 2.1 TeV, and 9 2 = 1(T 6 . 



D. The up-down approach 

Next, let us quote the theoretical predictions for the up-down approach for which the 
rotation and mixing matrices in the appendix are used. In this approach, the mixing of the 
ordinary quarks with the exotic ones exists, but it is small due to the fact that Vtb ~ 1- 
Also, new penguin diagrams like the one depicted in Fig. ([1]) exist, due to the fact that for 
this approach V t > q ^ 0. The following is the list of our results: 

« 3.4 x 1(T 9 . 
\V I 2 

Br*(b -> dry) = t^Bt* (6 -> s 7 ) ~ 3.6 x 1(T 10 , 

| Vt's\ 

« 1.0 x 1(T 14 
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Br b '( b "\c - u-y) 3a \(V; b ,V ub , + V; b „V ub „)F^(x b ' 



Bd^xm 2tt [f(x s )\V cs \* + f(x d )\V cd \*] 

« xlO" 18 



and finally 



B r _xi„ " 2tt [/(x 6 )|y t6 | 2 + /(x s )|F ts 
ss 1.5 x 1(T 14 



T),2. sx 10--. 
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5 r -> XZi/j 

All of them much smaller than the numbers calculated in the down-up approach, due to the 
now small mixing of the exotic quarks with the ordinary ones. 

Recalculating the meson mixing processes for this up-down approach, the Mz 2 mass 
value becomes now larger than 10 TeV in order to respect the experimental measurements 
(becomes larger than 12 TeV when the mixing is totally neglected, as it happens for example 
in the minimal 3-3-1 model of Pisano, Pleitez and Frampton 



VII. CONCLUSIONS 



The basic motivation of the present work was to study FCNC effects in the context of 
the 3-3-1 models with right-handed neutrinos. For this model there are four up-type quarks 
and five down-type quarks and its quark mixing matrix fails to be unitary. Besides, a new 
non- universal neutral current, able to produce FCNC effects at the tree level is present for 
this model. 

For this analysis we searched for the largest mixing between ordinary and exotic quarks 
without violating current experimental constrains in the quark mixing matrix and in the 
values and bounds measured for FCNC processes. 

Even though our analysis is "ansatz" dependent, two main approaches, with different 
consequences, can be distinguish: the first one characterized by a value of V t b ~ 0.8 and the 
second one for a value Vt& ~ 1. For the first approach the mixing of the ordinary quarks 
with the exotic ones is large, the penguin contributions to the FCNC are relevant and the 
tree-level meson mixing are perfectly under control for a mass Mz 2 at the TeV scale. For 
the second approach the mixing of the ordinary quarks with the exotic ones is small, the 

23 



penguin contribution to the FCNC are negligible, but the tree-level meson mixing became 
large, unless Mz 2 gets a mass larger than 10 TeV. 

The former conclusion is of relevance for the forthcoming Tevatron and LHC results, 
which should meassure with high accuracy the value of Vtb- In particular, a value of Vtb ~ 1 
associated with a new non-universal neutral Gauge Boson below the TeV scale are almost 
incompatible, and in particular will rule out not only the 3-3-1 model with right-handed 
neutrinos, but also most of the 3-3-1 extensions of the SM. On the contrary, a value of V t b 
in the range 0.8 < Vtb < 0.9 can coexist with a new non-universal neutral Gauge Boson at 
the TeV scale, with strong predictions of rare top decays such as t — > cZ, with a branching 
ratio of the order of 10~ 5 , perfectly reachable at the LHC 42 1. 

FCNC produced by Higgs scalar Fields are not relevant for the 3-3-1 model with right- 
handed neutrinos. For the third family they do not exist at tree-level because the Higgs 
field 02 which couples to the third family, does not couple to the other two families. For the 
first two families the processes may exist, but they are negligible small and proportional to 
(m s mrf/m|) 2 or to (m c m u /m|) 2 , where stands for the Higgs scalar mass. 

Finally, let us mention that in the context of the 3-3-1 model with right-handed neutrinos, 
no FCNC effects at tree-level are present in the lepton sector, due to the universality for 
leptons present in the weak basis. 



APPENDIX A: SM TEXTURES 

In order to explain the known hierarchy of the quark masses and mixing angles, several 
"ansatz" for up and down quark mass matrices have been suggested in the literature jsj], 
some of them including the so-called texture zeros |34|. In particular, symmetric mass 



matrices with four and five texture zeros were studied in detail in Refs. [35|, |36( , respectively. 
Unfortunately, precision measurements of several entries in the mixing matrix, rule out most 
of the suggested simple structures. 

In this appendix we are going to introduce what we have called the up-down approach 
which consists in fitting the data (six quark masses and three mixing angles) to a unitary 
3x3 mixing matrix, and then allow this matrix to loose its unitary character by letting the 
ordinary quarks to mix with the exotic ones . Contrary to the approach used in the main 
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hvM° u , 



(Al) 



text, this approach is characterized by the fact that V t h ~ 1. Our numerical study suggest 
to start with the following hermitian, parallel, four texture zeros ansatz for the SM quark 
mass matrices 

1 11.4A^ 
Ml = hv 2.8A 7 5.1A 3 

v 11.4A 4 5.1A 3 1 j 

' 1.45A 5 + 2iA 7 ^ 

M''.=lir o -1.4A 6 3A 5 + zA 7 

1.45A 5 -2iA 7 3A 5 -iA 7 1.6A 3 
where h is a Yukawa coupling constants fixed by the top quark mass. The former ansatz 
for up and down quark mass matrices has the extra ingredient of being compatible with 
a new kind of flavor symmetry and its perturbative breaking as proposed by Froggatt and 
Nielsen 38] , including a third order effect at the level of the bottom quark mass, implied by 
the entry (M 3 M ) 33 = 1.6A 3 . 

To check the validity of our ansatz let us use a value of A ~ 0.22 and hv = 170 GeV in 



V 



hvM° d , 



(A2) 



/ 



matrices flAlj) and (1A2|) which produce the following quark mass values in units of MeV: 



m t = 171500, m c = 614.4, m u = 2.3 



m b = 2940, m s = 53.4, m d = 2.8; 
numbers to be compared with the following values quoted from the second paper in Ref. 



25 1 



(where they were calculates at the Fermi scale \x = Mz, using the MS scheme): 



mt = 171700 ± 3000, m c = 619 ± 84, m u = 1.27±gl^ 



2890 ± 90, m s = 55±i|, m d = 2.90+^ 



19; 



(A3) 



The rotation matrices which diagonalize the Hermitian mass matrices M 3 and M 3 in 
(I All) and (IA2I) are given by 

f 0.89397 -0.44813 0.00046^ 

-0.44735 -0.89233 0.06019 , (A4) 
\ 0.02656 0.05401 0.99819 j 



yu 



rotu 
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and 



yd 
v 3 



( 0.97361 0.23347e" 2 - 9i 0.02145e" 3 - 8i \ 

0.23043e 29i 0.96825 0.09624e~ a92i 
^ 0.04322e 3 8i 0.08860e a92i 0.99512 j 



(A5) 



rotd 



The consistency of our analysis shows up when we calculate the absolute values of Vqkm 



\J\V-^V^\ 2 which gives the following values 



V, 



(0) 



V 



(A6) 



/ 



( 0.973 0.229 -0.0033 
0.229 -0.973 0.039 
0.0085 0.0377 0.999 

which is an (allmost) unitary matrix, in agreement with the experimental constrains quoted 
in matrix (1241) . 

Extending the previous analysis to the 3-3-1 model with right-handed neutrinos which 
includes four up type quarks and five down type quarks, we find that the maximall mixing 
allow of the ordinary quarks with the new ones, which does not violates the experimental 
values quoted in V exp in matrix (T241) . neither the quark mass values quoted above, preserving 
the allmost unitary character of (1A6I) . is given by 



h t v 



1.8A 3 5A S 



Mi 



d! 



h t v 



1.8A 

5A 3 
1 

1 10 

A 6 
A 5 



3 \ 



(A7) 



A 4 
A 4 



V 



(A8) 



0.6A 2 2.5A 2 -zA 4 
A 6 A 5 0.6A 2 10 1-iX 
A 4 A 4 2.5A 2 + «A 4 1 + iX 10 
The 4x4 rotation matrix which diagonalize the Hermitian mass matrices Ml in (|A7[) is 
now given by 

' -0.8936 0.4488 0.0002 -0.0007 
-0.4480 -0.8919 0.0606 -0.0005 
-0.0273 -0.0538 -0.9922 0.1093 
0.0022 0.0058 0.1092 0.9940 



\ 



\ 



(A9) 



rotu 
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and the 5x5 rotation matrix which diagonalize the Hermitian mass matrices in (IA8I) is 
now given by 



V* 



di 



0.9713 

0.2334e 3i 
0.0456e 4i 
e" 

: ,,-0.57i 



0.2368e~ 3i 
0.9669 

Q_Q 95e 0.96i 



1.75 x 10" 4 e- 13 - 2i 1.46 x 10" 



■4 e -l« 



y 1.6 x 10" 4 e 



1.8 x 10" 4 e 



0.0220e~ 41 
0.103e" a96i 

0.9944 
7.34e" 14 - 8i 



5.520 x 10-5e- 4 - 7i 8.6 x 10-4 e - L7i \ 



1.53 x 10"V 
1.72 x 10~ 3 e 



-8.3i 



-SAi 



9.51 x 10"V 



-2.5i 



~ 2M 9.6 x 10" 3 - 3 - 3i 



0.707 
0.706e 124i 



Matrices that we combine as V^ 1 

( 



V?'VV 5 dn \ 2 , 



V, 



4x5/ 



0.012e-°- 82i 

0.71e" 12 - 4i 

0.707 
(A10) 

producing the following values 
\ 



V 



(All) 



rotu 



-0.9741 0.2260 0.0031 0.0001 0.0001 

0.2260 0.9731 0.0449 0.0002 0.0003 

0.0082 0.0439 0.9929 0.0073 0.0096 

0.0017 0.0051 0.1092 0.0008 0.0011 

To finish, let us mention that from our 3x3 mass matrices (lAip and flA2[) we can obtain 
at the end a Vqkm mixing matrix depending only of a single phase. As a matter of fact, 
we have chosen allready three arbitrary phases in the up quark sector such that the mass 
matrix M u becomes real. Then, two more phases can be eliminated from V 3 d by a redefinition 
of the left-handed down quark fields, ending up with a single phase which propagates to 
Vckm = V3V3 • This single phase which shows up in a nonstandard parametrization of 
Vckm is the source of CP violation in the context of our ansatz. 
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